Information processing device, information processing method, and program

ABSTRACT

To activate communication between an autonomous operation body and a user. Providing an information processing device that includes: an application control unit that controls operation of an application relating to communication between an autonomous operation body and a user; and a reflection unit that causes the autonomous operation body to reflect an operation performed by the user in the application. In the information processing device, the application control unit controls operation of an avatar imitating the autonomous operation body, and the reflection unit causes the autonomous operation body to reflect a reward obtained by the avatar on the basis of the operation performed by the user.

TECHNICAL FIELD

The present disclosure relates to an information processing device, aninformation processing method, and a program.

BACKGROUND ART

Various devices with learning functions have been developed in recentyears. Such devices include autonomous operation bodies such as a robotthat performs an autonomous operation on the basis of an estimatedsituation. For example, Patent Document 1 discloses a robotics devicethat performs an information acquiring behavior as one behavior in anautonomous operation.

CITATION LIST PATENT DOCUMENT

Patent Document 1: Japanese Patent Application Laid-Open No. 2002-219677

SUMMARY OF THE INVENTION PROBLEMS TO BE SOLVED BY THE INVENTION

Meanwhile, an autonomous operation body like the one described in PatentDocument 1 can perform various autonomous behaviors even when the useris absent. However, if the situation in which the autonomous operationbody and the user can communicate with each other is limited to caseswhere the two share the same physical space, the communication becomesintermittent, and the user might not be able to fully enjoy theadvantage of owning the autonomous operation body.

Therefore, the present disclosure suggests a novel and improvedinformation processing device, an information processing method, and aprogram that can further activate communication between an autonomousoperation body and a user.

SOLUTIONS TO PROBLEMS

The present disclosure is to provide an information processing devicethat includes: an application control unit that controls operation of anapplication relating to communication between an autonomous operationbody and a user; and a reflection unit that causes the autonomousoperation body to reflect an operation performed by the user in theapplication. In the information processing device, the applicationcontrol unit controls operation of an avatar imitating the autonomousoperation body, and the reflection unit causes the autonomous operationbody to reflect a reward obtained by the avatar on the basis of theoperation performed by the user.

The present disclosure is also to provide an information processingmethod implemented by a processor, the information processing methodincluding: controlling operation of an application relating tocommunication between an autonomous operation body and a user; andcausing the autonomous operation body to reflect an operation performedby the user in the application. In the information processing method,the controlling further includes controlling operation of an avatarimitating the autonomous operation body, and the causing furtherincludes causing the autonomous operation body to reflect a rewardobtained by the avatar on the basis of the operation performed by theuser.

The present disclosure is also to provide a program for causing acomputer to function as an information processing device that includes:an application control unit that controls operation of an applicationrelating to communication between an autonomous operation body and auser; and a reflection unit that causes the autonomous operation body toreflect an operation performed by the user in the application. Theapplication control unit controls operation of an avatar imitating theautonomous operation body, and the reflection unit causes the autonomousoperation body to reflect a reward obtained by the avatar on the basisof the operation performed by the user.

EFFECTS OF THE INVENTION

As described above, according to the present disclosure, communicationbetween an autonomous operation body and a user can be made more active.

Note that the effect described above is not necessarily restrictive, andit is possible to achieve any one of the effects described in thisspecification together with the effect described above or instead of theeffect described above, or it is possible to achieve other effectsobvious from this specification.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram showing an example hardware configuration of anautonomous operation body according to an embodiment of the presentdisclosure.

FIG. 2 is an example configuration of actuators included in anautonomous operation body according to an embodiment of the presentdisclosure.

FIG. 3 is a diagram for explaining operation of an actuator included inan autonomous operation body according to an embodiment of the presentdisclosure.

FIG. 4 is a diagram for explaining operation of an actuator included inan autonomous operation body according to an embodiment of the presentdisclosure.

FIG. 5 is a diagram for explaining the functions of displays included inan autonomous operation body according to an embodiment of the presentdisclosure.

FIG. 6 is a diagram showing an example operation of an autonomousoperation body according to an embodiment of the present disclosure.

FIG. 7 is a diagram showing an example system configuration according toan embodiment of the present disclosure.

FIG. 8 is a diagram showing an example functional configuration of anautonomous operation body according to an embodiment of the presentdisclosure.

FIG. 9 is a diagram showing an example functional configuration of aninformation processing server according to an embodiment of the presentdisclosure.

FIG. 10 is a diagram showing an example functional configuration of aninformation processing terminal according to an embodiment of thepresent disclosure.

FIG. 11 is a diagram showing an example of the home screen of anapplication according to an embodiment of the present disclosure.

FIG. 12 is a diagram showing an example of the home screen of theapplication according to the embodiment.

FIG. 13 is an example of colors representing emotions of an autonomousoperation body according to the embodiment.

FIG. 14 is an example of an application menu screen according to theembodiment.

FIG. 15 is an example of a notification screen according to theembodiment.

FIG. 16 is an example of a content list screen according to theembodiment.

FIG. 17 is an example of a settings content screen according to theembodiment.

FIG. 18 is an example of an appearance change content screen accordingto the embodiment.

FIG. 19 is an example of an appearance change screen for colorexpressions of the eyeballs according to the embodiment.

FIG. 20 is a diagram for explaining reflection of settings caused by areflection unit according to the embodiment.

FIG. 21 is an example of a photo content screen according to theembodiment.

FIG. 22 is an example of a physical condition check content screenaccording to the embodiment.

FIG. 23 is an example of a game content screen according to theembodiment.

FIG. 24 is an example of a game content explanation screen according tothe embodiment.

FIG. 25 is a diagram for explaining an interaction between an autonomousoperation body and a user via a ball-shaped toy according to theembodiment.

FIG. 26 is a diagram for explaining an interaction between an autonomousoperation body and a user via a bone-shaped toy according to theembodiment.

FIG. 27 is an example of a reward acquisition pop-up according to theembodiment.

FIG. 28 is a flowchart showing the flow in appearance change settingscontrol to be performed by an information processing server according tothe embodiment.

FIG. 29 is a flowchart showing the flow in game content control to beperformed by the information processing server according to theembodiment.

FIG. 30 is a diagram showing an example hardware configuration accordingto an embodiment of the present disclosure.

MODES FOR CARRYING OUT THE INVENTION

The following is a detailed description of preferred embodiments of thepresent disclosure, with reference to the accompanying drawings. Notethat, in this specification and the drawings, components havingsubstantially the same functional configurations are denoted by the samereference numerals, and explanation of them will not be repeated.

Note that explanation will be made in the following order.

1. Configuration

1.1. Overview of an autonomous operation body 10

1.2. Example hardware configuration of an autonomous operation body 10

1.3. Example system configuration

1.4. Example functional configuration of an autonomous operation body 10

1.5. Example functional configuration of an information processingserver 20

1.6. Example functional configuration of an information processingterminal 30

2. First embodiment

2.1. Overview

2.2. Details of an application

2.3. Control flow

3. Example hardware configuration

4. Summary

1. Configuration 1.1. Overview of an Autonomous Operation Body 10

First, an overview of an autonomous operation body 10 according to anembodiment of the present disclosure is described. The autonomousoperation body 10 according to an embodiment of the present disclosureis an information processing device that estimates situations on thebasis of collected sensor information, and autonomously selects andperforms various operations depending on the situations. Unlike a robotthat performs operations simply in accordance with instruction commandsfrom a user, the autonomous operation body 10 autonomously performsoperations estimated to be optimal in the respective situations.

For this reason, the autonomous operation body 10 according to anembodiment of the present disclosure does not perform an operationcorresponding to a user's instruction, or performs a different behaviorfrom the operation in some cases, depending on the situation. The abovesituation corresponds to, for example, a case where an operationcorresponding to the user's instruction is performed, a case where thesafety of the user or the autonomous operation body 10 or the ambientenvironment is impaired, a case where the autonomous operation body 10puts priority on some other desire (instinct) such as a chargingprocess, or the like.

Further, there are cases where the autonomous operation body 10 does notfollow the user's instruction on purpose to attract the user's attentionor to inform the user of its own emotion or the state of the hardware.

On the other hand, the autonomous operation body 10 has a strong desire(instinct) to be loved by the user. For this reason, the autonomousoperation body 10 repeatedly performs the operation corresponding to theuser's instruction to please the user, or learns the operation the userlikes and spontaneously performs the operation even in a case wherethere is no instruction.

As described above, the autonomous operation body 10 according to anembodiment of the present disclosure comprehensively judges its desireand emotion, or the ambient environment or the like, and determines andperforms an autonomous operation, like animals including humans. In theabove aspect, the autonomous operation body 10 is clearly different froma passive device that performs the corresponding operation in accordancewith an instruction.

The autonomous operation body 10 according to an embodiment of thepresent disclosure may be an autonomous mobile robot that autonomouslymoves in a space and performs various kinds of operations. Theautonomous operation body 10 may be an autonomous mobile robot that isthe shape of an animal such as a human or a dog, and has an operationcapability, for example. Alternatively, the autonomous operation body 10may be a vehicle or another device having a capability for communicatingwith a user, for example. The levels of the shape, a capability, adesire, and the like of the autonomous operation body 10 according to anembodiment of the present disclosure can be designed as appropriateaccording to the purpose and the role.

1.2. Example Hardware Configuration of an Autonomous Operation Body 10

Next, an example hardware configuration of an autonomous operation body10 according to an embodiment of the present disclosure is described.Note that, in the example case described below, the autonomous operationbody 10 is a quadrupedal walking robot in the shape of a dog.

FIG. 1 is a diagram showing an example hardware configuration of theautonomous operation body 10 according to an embodiment of the presentdisclosure. As shown in FIG. 1, the autonomous operation body 10 is adog-like quadrupedal walking robot having a head, a torso, four legs,and a tail. The autonomous operation body 10 also includes two displays510 on the head.

The autonomous operation body 10 also includes various kinds of sensors.For example, the autonomous operation body 10 includes microphones 515,cameras 520, a Time of Flight (ToF) sensor 525, a human-presence sensor530, distance measurement sensors 535, touch sensors 540, an illuminancesensor 545, sole buttons 550, and inertia sensors 555.

Microphones 515

The microphones 515 have a function of collecting ambient sounds. Theabove sounds include user's utterances and the surrounding environmentalsounds, for example. The autonomous operation body 10 may include fourmicrophones on the head, for example. As a plurality of microphones 515is included, it is possible to collect sound generated in thesurroundings with high sensitivity, and realize localization of thesound source.

Cameras 520

The cameras 520 have a function of imaging the user and the ambientenvironment. The autonomous operation body 10 may include two wide-anglecameras at the tip of the nose and on the waist, for example. In thiscase, the wide-angle camera disposed at the tip of the nose captures animage corresponding to the front field of view of the autonomousoperation body (which is the field of view of the dog), and thewide-angle camera on the waist captures an image of the surroundingregion centered on the space above. The autonomous operation body 10 canperform simultaneous localization and mapping (SLAM) by extractingfeature points of the ceiling and the like on the basis of the imagecaptured by the wide-angle camera disposed on the waist, for example.

ToF Sensor 525

The ToF sensor 525 has a function of detecting the distance to an objectexisting in front of the head. The ToF sensor 525 is disposed at the tipof the nose of the head. With the ToF sensor 525, it is possible todetect the distances to various objects with high accuracy, and performoperations in accordance with the relative positions with respect toobjects including the user, obstacles, and the like.

Human-Presence Sensor 530

The human-presence sensor 530 has a function of detecting the presenceof the user, a pet being kept by the user, or the like. Thehuman-presence sensor 530 is disposed on the chest, for example. Withthe human-presence sensor 530, it is possible to detect moving objectsexisting ahead, and perform various operations with respect to themoving objects, such as operations corresponding to emotions includinginterests, fears, and surprises, for example.

Distance Measurement Sensors 535

The distance measurement sensors 535 have a function of acquiring thestate of the floor in front of the autonomous operation body 10. Thedistance measurement sensors 535 are disposed on the chest, for example.With the distance measurement sensors 535, the distance to an objectexisting on the floor in front of the autonomous operation body 10 canbe detected with high accuracy, and an operation in accordance with theposition relative to the object can be performed.

Touch Sensors 540

The touch sensors 540 have a function of detecting contact by a user.The touch sensors 540 are disposed at a position at which the user islikely to touch the autonomous operation body 10, such as the top of thehead, the lower chin, and the back, for example. The touch sensors 540may be capacitive or pressure-sensitive touch sensors, for example. Withthe touch sensors 540, it is possible to detect contact actions such astouching, stroking, patting, and pressing by the user, and performoperations corresponding to the contact actions.

Illuminance Sensor 545

The illuminance sensor 545 detects the illuminance of the space in whichthe autonomous operation body 10 exists. The illuminance sensor 545 maybe disposed at, for example, the base of the tail on the back of thehead, and the like. With the illuminance sensor 545, it is possible todetect the ambient brightness, and perform an operation corresponding tothe brightness.

Sole Buttons 550

The sole buttons 550 have a function of detecting whether or not thebottom surfaces of the legs of the autonomous operation body 10 are incontact with the floor. Therefore, the sole buttons 550 are disposed atthe portions corresponding to the paws of the four legs. With the solebuttons 550, it is possible to detect contact or non-contact between theautonomous operation body 10 and the floor surface, and for example,recognize that the autonomous operation body 10 is lifted up by theuser, and the like.

Inertia Sensors 555

The inertia sensors 555 are six-axis sensor that detect physicalquantities such as velocities, accelerations, and rotations of the headand the torso. That is, the inertia sensors 555 detect accelerations andangular velocities of the X-axis, the Y-axis, and the Z-axis. Theinertia sensors 555 are disposed on the head and the torso. With theinertia sensors 555, movement of the head and the torso of theautonomous operation body 10 can be detected with high accuracy, andmotion control depending on situations can be performed.

An example of the sensors included in the autonomous operation body 10according to an embodiment of the present disclosure has been describedabove. Note that the configuration described above with reference toFIG. 1 is merely an example, and the configuration of the sensorsincluded in the autonomous operation body 10 is not limited to such anexample. The autonomous operation body 10 may further include atemperature sensor, a geomagnetic sensor, various communication devicesincluding a global navigation satellite system (GNSS) signal receiver,and the like, for example, in addition to the configuration describedabove. The configuration of the sensors included in the autonomousoperation body 10 can be flexibly changed depending on specificationsand operations.

Next, an example configuration of the joints of the autonomous operationbody 10 according to an embodiment of the present disclosure isdescribed. FIG. 2 is an example configuration of actuators 570 includedin the autonomous operation body 10 according to an embodiment of thepresent disclosure. The autonomous operation body 10 according to anembodiment of the present disclosure has a total of 22 rotationaldegrees of freedom: two each at the ears and the tail, and one in themouth, in addition to the respective rotational portions shown in FIG.2.

For example, the autonomous operation body 10 has three degrees offreedom in the head, so that the autonomous operation body 10 can bothnod and tilt its head. The autonomous operation body 10 also reproduceswaist swinging motions with the actuators 570 in the waist, so that theautonomous operation body 10 can perform natural and flexible behaviorssimilar to a real dog.

Note that the autonomous operation body 10 according to an embodiment ofthe present disclosure may achieve the above 22 rotational degrees offreedom by combining uniaxial actuators and biaxial actuators, forexample. For example, uniaxial actuators may be adopted in the elbowsand knees in the legs, and biaxial actuators may be adopted in theshoulders and the bases of the thighs.

FIGS. 3 and 4 are diagrams for explaining operation of an actuator 570included in the autonomous operation body 10 according to an embodimentof the present disclosure. As shown in FIG. 3, the actuator 570 candrive a movable arm 590 at a desired rotating position and a desiredrotating velocity by rotating an output gear with a motor 575.

As shown in FIG. 4, an actuator 570 according to an embodiment of thepresent disclosure includes a rear cover 571, a gear box cover 572, acontrol board 573, a gear box base 574, the motor 575, a first gear 576,a second gear 577, an output gear 578, a detection magnet 579, and twobearings 580.

The actuator 570 according to an embodiment of the present disclosuremay be a magnetic spin-valve giant magnetoresistive (svGMR), forexample. Under the control of the main processor, the control board 573rotates the motor 575, so that power is transmitted to the output gear578 via the first gear 576 and the second gear 577, and the movable arm590 can be driven.

Further, a position sensor included in the control board 573 detects theangle of rotation of the detection magnet 579 that rotates insynchronization with the output gear 578, so that the angle of rotationof the movable arm 590, which is the rotating position, can be detectedwith high accuracy.

Note that, being of a noncontact type, the magnetic svGMR excels indurability. Further, the magnetic svGMR is used in a GMR saturationregion, to advantageously reduce influence of signal variations causedby distance variations of the detection magnet 579 and the positionsensor.

The above is a description of an example configuration of the actuators570 included in the autonomous operation body 10 according to anembodiment of the present disclosure. With the configuration describedabove, it is possible to control bending/stretching actions of thejoints included in the autonomous operation body 10 with high accuracy,and correctly detect the rotating positions of the joints.

Next, the functions of the displays 510 included in the autonomousoperation body 10 according to an embodiment of the present disclosureare described with reference to FIG. 5. FIG. 5 is a diagram forexplaining the functions of the displays 510 included in the autonomousoperation body 10 according to an embodiment of the present disclosure.

Displays 510

The displays 510 have a function of visually presenting movements of theeyes and emotions of the autonomous operation body 10. As shown in FIG.5, the displays 510 can express movements of the eyeballs, the pupils,and the eyelids in accordance with emotions and actions. The displays510 do not display characters, symbols, images that are not related toeye movements, and the like, to produce natural movements similar tothose of an actual animal such as a dog.

As shown in FIG. 5, the autonomous operation body 10 also includes twodisplays 510 r and 510 l corresponding to the right eye and the lefteye, respectively. The displays 510 r and 510 l are formed with twoindependent organic light emitting diodes (OLEDs), for example. TheOLEDs make it possible to reproduce the curved surfaces of the eyeballs,and realize a more natural exterior than in a case where the pair ofeyeballs is formed with a single flat display, or where the two eyes areformed with two independent flat displays.

As described above, with the displays 510 r and 510 l, it is possible toexpress lines of sight and emotions of the autonomous operation body 10as shown in FIG. 5 with high accuracy and flexibility. Further, the usercan intuitively understand the state of the autonomous operation body 10from eye movements displayed on the displays 510.

The above is a description of the example hardware configuration of theautonomous operation body 10 according to an embodiment of the presentdisclosure. With the configuration described above, movements of thejoints and the eyeballs of the autonomous operation body 10 are flexiblycontrolled with high accuracy, so that movements and emotionalexpressions similar to those of an actual animal can be obtained asshown in FIG. 6. Although FIG. 6 is a diagram showing an exampleoperation of the autonomous operation body 10 according to an embodimentof the present disclosure, FIG. 6 shows a simplified view of theexternal structure of the autonomous operation body 10, to explainmainly movements of the joints and the eyeballs of the autonomousoperation body 10. Likewise, in the description below, the externalstructure of the autonomous operation body 10 will be simplified in somecases, but the hardware configuration and the exterior of the autonomousoperation body 10 according to an embodiment of the present disclosuremay be designed as appropriate, without being limited to the exampleshown in the drawings.

1.3. Example System Configuration

Next, an example system configuration according to an embodiment of thepresent disclosure is described. FIG. 7 is a diagram showing an examplesystem configuration according to an embodiment of the presentdisclosure. As shown in FIG. 7, an information processing systemaccording to an embodiment of the present disclosure includes aplurality of autonomous operation bodies 10, an information processingserver 20, and an information processing terminal 30. Note that therespective components included in the information processing system areconnected via a network 40 so that they can communicate with oneanother.

Autonomous Operation Bodies 10

An autonomous operation body 10 according to an embodiment of thepresent disclosure is an information processing device that estimatessituations on the basis of collected sensor information, andautonomously selects and performs various operations depending on thesituations. As described above, ab autonomous operation body 10according to an embodiment of the present disclosure may be anautonomous mobile robot that is in the shape of an animal such as ahuman or a dog, and has an operation capability, for example.

Information Processing Server 20

The information processing server 20 according to an embodiment of thepresent disclosure is an information processing device that is connectedto a plurality of autonomous operation bodies 10, and has a function ofcollecting various kinds of information from the autonomous operationbodies 10. The information processing server 20 can analyze the state ofthe hardware of an autonomous operation body 10, the user's degree ofenthusiasm for the autonomous operation body 10, and the like, on thebasis of sensor information collected by the autonomous operation body10, for example.

The information processing server 20 also has a function of presenting arecommended action to be performed by an autonomous operation body 10 ina situation estimated by the autonomous operation body 10. In this case,the information processing server 20 may transmit, to the autonomousoperation body 10, control sequence data for causing the autonomousoperation body 10 to perform the recommended action.

The information processing server 20 according to an embodiment of thepresent disclosure also controls operation of an application relating tocommunication between an autonomous operation body 10 and the user. Inthe application, the information processing server 20 may dynamicallycontrol the output expression of an avatar reflecting the state of theautonomous operation body, for example. The information processingserver 20 also has a function of causing the autonomous operation body10 to reflect a user operation performed on the avatar described above.With the above functions of the information processing server 20, it ispossible to realize communication between an autonomous operation body10 and the user, not depending on the locations of the autonomousoperation body 10 and the user.

Information Processing Terminal 30

The information processing terminal 30 according to an embodiment of thepresent disclosure is an information processing device that provides auser with a user interface relating to the above described application.The information processing terminal 30 according to an embodiment of thepresent disclosure may be a mobile phone, a smartphone, a tablet, any ofvarious wearable devices, a general-purpose computer, or the like, whichis owned by the user, for example.

Network 40

The network 40 has a function of connecting the respective componentsincluded in the information processing system. The network 40 mayinclude a public line network such as the Internet, a telephone linenetwork, and a satellite communication network, various kinds of localarea networks (LANs) including Ethernet (registered trademark), widearea networks (WANs), and the like. The network 40 may also include adedicated line network such as an Internet protocol-virtual privatenetwork (IP-VPN). The network 40 may further include a wirelesscommunication network such as Wi-Fi (registered trademark) and Bluetooth(registered trademark).

The above is a description of an example system configuration accordingto an embodiment of the present disclosure. Note that the configurationdescribed above with reference to FIG. 7 is merely an example, and theconfiguration of the information processing system according to anembodiment of the present disclosure is not limited to the example. Forexample, the autonomous operation body 10 may further performinformation communication with various kinds of external devices otherthan the information processing server 20. The external devicesdescribed above may include a server that transmits weather, news, andother service information, various kinds of information processingterminals owned by the user, and home appliances, for example. Thesystem configuration according to an embodiment of the presentdisclosure can be flexibly modified depending on specifications andoperations.

1.4. Example Functional Configuration of an Autonomous Operation Body 10

Next, an example functional configuration of an autonomous operationbody 10 according to an embodiment of the present disclosure isdescribed. FIG. 8 is a diagram showing an example functionalconfiguration of an autonomous operation body 10 according to anembodiment of the present disclosure. As shown in FIG. 8, the autonomousoperation body 10 according to an embodiment of the present disclosureincludes an input unit 110, a recognition unit 120, a learning unit 130,an action planning unit 140, an operation control unit 150, a drive unit160, an output unit 170, and a communication unit 180.

Input Unit 110

The input unit 110 has a function of collecting various kinds ofinformation relating to the user and the ambient environment. The inputunit 110 collects user's utterances and environmental sounds generatedaround the user, image information relating to the user and the ambientenvironment, and various kinds of sensor information, for example. To doso, the input unit 110 includes the various kinds of sensors shown inFIG. 1.

Recognition Unit 120

The recognition unit 120 has a function of performing various kinds ofrecognition relating to the user, the ambient environment, and the stateof the autonomous operation body 10, on the basis of the various kindsof information collected by the input unit 110. In an example, therecognition unit 120 may perform human identification, facial expressionand sight line recognition, object recognition, color recognition, shaperecognition, marker recognition, obstacle recognition, step recognition,brightness recognition, and the like.

The recognition unit 120 also performs emotion recognition relating tothe user's voice, word recognition, sound source localization, and thelike. The recognition unit 120 can also recognize contact by a user orthe like, the ambient temperature, the presence of a moving object, theposture of the autonomous operation body 10, and the like.

The recognition unit 120 further has a function of estimating andunderstanding the ambient environment and the situation in which theautonomous operation body 10 is currently in, on the basis of theinformation recognized as above. In doing so, the recognition unit 120may comprehensively estimate the situation, using environmentalknowledge stored therein in advance.

Learning Unit 130

The learning unit 130 has a function of learning environment (situation)and an action, and the effects of the action on the environment. Thelearning unit 130 performs the learning described above, using a machinelearning algorithm such as deep learning, for example. Note that thelearning algorithm adopted by the learning unit 130 is not limited tothe example described above, and can be designed as appropriate.

Action Planning Unit 140

The action planning unit 140 has a function of planning an action to beperformed by the autonomous operation body 10, on the basis of thesituation estimated by the recognition unit 120 and the knowledgelearned by the learning unit 130. The functions of the action planningunit 140 according to an embodiment of the present disclosure will bedescribed later in detail.

Operation Control Unit 150

The operation control unit 150 has a function of controlling operationsof the drive unit 160 and the output unit 170, on the basis of theaction planned by the action planning unit 140. The operation controlunit 150 performs rotation control on the actuators 570, display controlon the displays 510, sound output control on a speaker, and the like, onthe basis of the action plan described above, for example. The functionsof the operation control unit 150 according to an embodiment of thepresent disclosure will be described later in detail.

Drive Unit 160

The drive unit 160 has a function of causing the plurality of joints ofthe autonomous operation body 10 to bend and stretch, under the controlof the operation control unit 150. More specifically, the drive unit 160drives the actuators 570 provided at the respective joints, under thecontrol of the operation control unit 150.

Output Unit 170

The output unit 170 has a function of outputting visual information andaudio information, under the control of the operation control unit 150.Therefore, the output unit 170 includes the displays 510 and a speaker.

Communication Unit 180

The communication unit 180 has a function of performing informationcommunication with the information processing server 20, the informationprocessing terminal 30, and another autonomous operation body 10. Forexample, the communication unit 180 transmits information relating tothe situation recognized by the recognition unit 120 and the like, tothe information processing server 20. The communication unit 180 alsoreceives, from the information processing server 20, a recommendedaction, control sequence data relating to the recommended action, andthe data corresponding to a reward described later, for example.

The above is an example functional configuration of an autonomousoperation body 10 according to an embodiment of the present disclosure.Note that the configuration described above with reference to FIG. 8 ismerely an example, and the functional configuration of an autonomousoperation body 10 according to an embodiment of the present disclosureis not limited to this example. The functional configuration of anautonomous operation body 10 according to an embodiment of the presentdisclosure can be flexibly modified depending specifications andoperations.

1.5. Example Functional Configuration of the Information ProcessingServer 20

Next, an example functional configuration of the information processingserver 20 according to an embodiment of the present disclosure isdescribed. FIG. 9 is a diagram showing an example functionalconfiguration of the information processing server 20 according to anembodiment of the present disclosure. As shown in FIG. 9, theinformation processing server 20 according to an embodiment of thepresent disclosure includes a learning unit 210, an actionrecommendation unit 220, an analysis unit 230, a storage unit 240, anapplication control unit 250, a reflection unit 260, and a terminalcommunication unit 270.

Learning Unit 210

The learning unit 130 has a function of learning environment (situation)and an action, and the effects of the action on the environment. In thiscase, the learning unit 210 characteristically performs learning basedon an action history collected from the plurality of autonomousoperation bodies 10. In other words, the learning unit 210 can beregarded as collective intelligence shared by the plurality ofautonomous operation bodies 10.

Action Recommendation Unit 220

The action recommendation unit 220 has a function of determining anaction to be recommended to an autonomous operation body 10, on thebasis of information relating to an estimated situation received fromthe autonomous operation body 10, and the knowledge held as thecollective intelligence by the learning unit 210. Further, one of thefeatures of the action recommendation unit 220 is to transmit arecommended action and control sequence data for causing the autonomousoperation body 10 to perform the recommended action, to the autonomousoperation body via the terminal communication unit 270.

Here, the control sequence data described above is information includingcontrol signals relating to chronological changes in the rotatingpositions of the joints of the autonomous operation body 10, eyeballexpressions, and sound outputs. That is, the control sequence data canbe regarded as settings data for causing the autonomous operation body10 to perform a desired operation (action).

With the above functions of the action recommendation unit 220 accordingto an embodiment of the present disclosure, a new action that can beperformed by the autonomous operation body 10 can be added at any time,the user's interest in the autonomous operation body 10 can becontinuously maintained, and the like.

Analysis Unit 230

The analysis unit 230 has a function of performing various kinds ofanalysis, on the basis of information received from an autonomousoperation body 10. The analysis unit 230 can analyze the states of theactuators 570 and the like, on the basis of an action history and anoperational status received from the autonomous operation body 10, forexample. The analysis unit 230 can also analyze the user's interest in(enthusiasm for) the autonomous operation body 10 or the like, on thebasis of information about the user's contact and reaction received fromthe autonomous operation body 10, and the like.

Storage Unit 240

The storage unit 240 has a function of accumulating information to beused by the respective components of the information processing server20. The storage unit 240 stores control sequence data received from anautonomous operation body 10 associated with the situation and theuser's reaction, for example. The storage unit 240 also storesinformation to be used by the analysis unit 230 in performing analysis,and analysis results. The storage unit 240 also stores various kinds ofdata relating to applications and rewards described later.

Application Control Unit 250

The application control unit 250 controls operation of an applicationrelating to communication between an autonomous operation body 10 andthe user. The application control unit 250 controls the operation andthe output expression of an avatar imitating the autonomous operationbody 10 in the application, for example. In doing so, the applicationcontrol unit 250 may perform output control reflecting the operatingcondition and the emotion of the autonomous operation body 10. Thefunctions of the application control unit 250 will be described later indetail.

Reflection Unit 260

The reflection unit 260 has a function of causing an autonomousoperation body 10 to reflect a user operation in an application. Thereflection unit 260 can cause an autonomous operation body 10 to reflecta reward obtained by the avatar, on the basis of an operation performedby the user, for example. The functions of the reflection unit 260 willbe described later in detail.

Terminal Communication Unit 270

The terminal communication unit 270 has a function of performinginformation communication with the plurality of autonomous operationbodies 10 via the network 40. The terminal communication unit 270receives information relating to an estimated situation from anautonomous operation body 10, for example. The terminal communicationunit 270 also transmits information relating to a recommended actiondetermined by the action recommendation unit 220 and control sequencedata, to the autonomous operation body 10, for example.

Under the control of the reflection unit 260, the terminal communicationunit 270 also transmits, to the autonomous operation body 10, variouskinds of control signals for causing the autonomous operation body 10 toreflect settings made by the user in an application and a rewardobtained by the avatar.

The above is a description of an example functional configuration of theinformation processing server 20 according to an embodiment of thepresent disclosure. Note that the configuration described above withreference to FIG. 9 is merely an example, and the functionalconfiguration of the information processing server 20 according to anembodiment of the present disclosure is not limited to this example. Forexample, the various kinds of functions of the information processingserver 20 may be scattered over a plurality of devices. The functionalconfiguration of the information processing server 20 according to anembodiment of the present disclosure can be flexibly modified dependingspecifications and operations.

1.6. Example Functional Configuration of the Information ProcessingTerminal 30

Next, an example functional configuration of the information processingterminal 30 according to an embodiment of the present disclosure isdescribed. FIG. 10 is a diagram showing an example functionalconfiguration of the information processing terminal 30 according to anembodiment of the present disclosure. As shown in FIG. 10, theinformation processing terminal 30 according to an embodiment of thepresent disclosure includes an input unit 310, a display unit 320, asound output unit 330, a control unit 340, and a communication unit 350.

Input Unit 310

The input unit 310 has a function of detecting an input operationperformed by the user. Therefore, the input unit 310 includes akeyboard, a touch panel, various kinds of buttons, and the like. Theinput unit 310 may also include a microphone or the like that detects avoice input by the user. The input unit 310 may further include animaging device that captures an image of the user or the like.

Display Unit 320

The display unit 320 has a function of presenting various kinds ofvisual information to the user. For example, the display unit 320displays a user interface relating to the application described above,under the control of the information processing server 20. To do so, thedisplay unit 320 includes various kinds of display devices.

Sound Output Unit 330

The sound output unit 330 has a function of outputting various kinds ofsound. For example, the sound output unit 330 outputs various kinds ofsound relating to the application described above, under the control ofthe information processing server 20. To do so, the sound output unit330 includes a speaker, an amplifier, and the like.

Control Unit 340

The control unit 340 comprehensively controls the respective componentsincluded in the information processing terminal 30. The control unit 340may control activation and suspension of each component, for example.The control unit 340 also has a function of transferring various kindsof control signals generated by the information processing server 20 tothe display unit 320 and the sound output unit 330. The control unit 340may also have functions equivalent to those of the application controlunit 250 and the reflection unit 260 of the information processingserver 20.

Communication Unit 350

The communication unit 350 performs information communication with theinformation processing server 20 and the autonomous operation bodies 10via the network 40. For example, the communication unit 350 receives,from the information processing server 20, a control signal relating toan application, and data relating to a reward described below. Thecommunication unit 350 also transmits information relating to the user'soperation detected by the input unit 310 to the information processingserver 20, for example.

The above is a description of an example functional configuration of theinformation processing terminal 30 according to an embodiment of thepresent disclosure. Note that the functional configuration describedabove with reference to FIG. 10 is merely an example, and the functionalconfiguration of the information processing terminal 30 according to anembodiment of the present disclosure is not limited to this example. Forexample, the information processing terminal 30 may have functionsequivalent to those of the application control unit 250 and thereflection unit 260 of the information processing server 20, asdescribed above. The functional configuration of the informationprocessing terminal 30 according to an embodiment of the presentdisclosure can be flexibly modified depending specifications andoperations.

2. First Embodiment 2.1. Overview

Next, a first embodiment of the present disclosure is described. Asdescribed above, an autonomous operation body 10 according to anembodiment of the present disclosure includes the displays 510 thatexpress movements of a plurality of joints and the eyeballs, and thus,is capable of performing various kinds of operations. Such autonomousoperations as described above may be performed even when the user isabsent.

In general, however, the user can sense operations of the autonomousoperation body 10 and communicate with the autonomous operation body 10only in a case where the two share the same physical space. For thisreason, in a case where the user tends to be away from home for work orschool, for example, the user can neither know the actions of theautonomous operation body 10 for many hours of the day, nor communicatewith the autonomous operation body 10.

In this case, it is assumed that the user cannot fully enjoy theadvantage of owning the autonomous operation body 10, and, as a resultof intermittent communication due to the absence of the user, the usermight gradually lose interest in the autonomous operation body 10.

To counter the above problem, it is possible for the user, for example,to remotely monitor the state of the autonomous operation body 10 from aplace away from home, and the like. In this case, however, the userhardly enjoys interactive communication with the autonomous operationbody 10, while being able to know the state of the autonomous operationbody 10.

Therefore, an information processing server 20 according to the firstembodiment of the present disclosure provides the user with anapplication that enables interactive communication between an autonomousoperation body 10 and the user, to solve the above problem.

The information processing server 20 according to this embodiment maycontrol operation of an avatar imitating the autonomous operation body10 owned by the user in the application described above, for example. Indoing so, the information processing server 20 according to thisembodiment may cause the output expression of the avatar to reflect thecurrent state of the autonomous operation body 10. The state describedabove includes an autonomous operation being performed by the autonomousoperation body 10, an emotion of the autonomous operation body 10, andthe like, for example.

With the above function of the information processing server 20according to this embodiment, the user can know the current state of theautonomous operation body 10 even from outside the home, and can obtaina feeling of being with the autonomous operation body 10 all the like.Thus, an effect to maintain the user's interest in the autonomousoperation body 10 can be expected.

Further, one of the features of the information processing server 20according to this embodiment is a function of causing the autonomousoperation body 10 to reflect an operation performed on the avatar by theuser. The information processing server 20 may provide game content forenabling communication between the avatar and the user, for example. Indoing so, the information processing server 20 can give a reward on thebasis of an operation performed on the avatar by the user in the gamecontent, and cause the autonomous operation body 10 to reflect thereward.

For example, in the game content described above, the user may be ableto perform various communication-related operations on the avatar, suchas touching, stroking, and playing with a toy such as a ball. In thiscase, the information processing server 20 according to this embodimentgives a reward on the basis of a fact that the intensity of thecommunication has exceeded a predetermined value, and causes the avatarand the autonomous operation body 10 to reflect the reward. Here, thereward described above may be a variation relating to the exterior orvoice of the autonomous operation body 10, a new operation that theautonomous operation body 10 can perform, or the like, for example.

That is, by deepening the communication with the avatar in theapplication, the user can enjoy the result of the communication as afunctional enhancement of the autonomous operation body 10. With theabove functions of the information processing server 20 according tothis embodiment, even from outside the home or the like, the user cancontinue to have interactive communication with the autonomous operationbody 10. Thus, It is possible to maintain the user's interest in theautonomous operation body 10, and satisfy the user's desire to be withthe autonomous operation body 10 all the time.

2.2. Details of the Application

In the description below, the functions of the application according tothis embodiment are described in detail, with reference to specificexamples. As described above, the application according to thisembodiment includes game content that enables communication between anavatar imitating an autonomous operation body 10 and the user.

On the other hand, the functions of the application according to thisembodiment are not limited to the examples. The application according tothis embodiment widely covers functions for allowing the user to knowthe state of the autonomous operation body 10 and functions for causingthe autonomous operation body 10 to reflect settings made by the user.

The application according to this embodiment may also have a functionfor presenting a notification from the distributor of the autonomousoperation body 10 to the user, and a function of activatingcommunication between users. The application according to thisembodiment may be a comprehensive application including various kinds offunctions for enhancing convenience for the user owning the autonomousoperation body 10.

First, the home screen of the application according to this embodimentis described. FIGS. 11 and 12 are diagrams each showing an example ofthe home screen of the application according to this embodiment. Asshown in FIGS. 11 and 12, an avatar AV imitating the autonomousoperation body 10 owned by the user is displayed on the home screenaccording to this embodiment.

The application control unit 250 may cause the screen to display theavatar AV that is a 3D model imitating the exterior, the voice(barking), and the like of the autonomous operation body 10 owned by theuser, for example. Here, the exterior described above includes colorssuch as the eyeballs (pupils, irises, and the like) and the body colorof the autonomous operation body 10, for example.

The application control unit 250 according to this embodiment may alsocontrol the output expression relating to the avatar AV, on the basis ofthe state of the autonomous operation body 10. The output expressiondescribed above may include an operation display, a color expression, anaudio output, and the like. The application control unit 250 can causethe operation display of the avatar AV to reflect the action beingperformed by the autonomous operation body 10, for example.

For example, in the example case illustrated in FIG. 11, the applicationcontrol unit 250 can cause the screen to display the avatar AV lyingdown, on the basis of the fact that the autonomous operation body 10 islying down. Also, in the example case illustrated in FIG. 12, theapplication control unit 250 can cause the screen to display the avatarAV being charged on a charging station CS, for example, on the basis ofthe fact that the autonomous operation body 10 doing the same.

In addition to the above examples, the application control unit 250 cancause the avatar AV in the application to reflect various kinds ofoperations such as sitting, walking, and lying flat, which are performedby the autonomous operation body 10.

The application control unit 250 according to this embodiment may alsocause the output expression of the avatar to reflect an emotion of theautonomous operation body 10. In the example cases illustrated in FIGS.11 and 12, the application control unit 250 sets the color of thebackground BG on the home screen, on the basis of the current emotion ofthe autonomous operation body 10.

FIG. 13 is an example of colors representing emotions of the autonomousoperation body 10 according to this embodiment. As shown in FIG. 13,emotions of the autonomous operation body 10 according to thisembodiment may be expressed in various predetermined colors, such aspink for affection and yellow for joy, for example. Further, theintensity of each emotion may be expressed by shades of the color, forexample. In a case where two or more emotions coexist, the emotions areexpressed by gradation or the like of the two or more correspondingcolors.

As described above, with the application control unit 250 according tothis embodiment, it is possible to control not only operation of theautonomous operation body 10 but also the output expression of theavatar AV reflecting various states including emotions. With the abovefunctions of the application control unit 250 according to thisembodiment, the user can know the state of the autonomous operation body10 even from outside the home, and can a feeling of being with theautonomous operation body 10 all the time.

Referring back to FIGS. 11 and 12, explanation of the screenconfiguration of the application is continued. As shown in FIGS. 11 and12, buttons bll through b13 may be displayed on the home screen of theapplication according to this embodiment.

The button bll may be a link to an application menu, for example. FIG.14 is an example of an application menu screen according to thisembodiment. As shown in FIG. 14, the application menu according to thisembodiment includes pet (autonomous operation body 10) registration,tutorial, help guide, support, owner (user) information, stores, fanpages, sign out, and application overview information or the like.

The pet registration described above may be a function for linking theautonomous operation body 10 owned by the user to the application. Theuser can link the application to the autonomous operation body 10 bysetting information about the user's autonomous operation body 10through the pet registration. Note that the user can link a plurality ofautonomous operation bodies 10 to the application. In this case, aplurality of avatars AV is displayed on the home screen, for example.The user selects a desired avatar AV, to use the functions linked to thecorresponding autonomous operation body 10.

Meanwhile, the stores described above may include an online store fromwhich an option related to a functional enhancement of the autonomousoperation body 10 can be purchased. The user can enhance the functionsof the autonomous operation body 10 by purchasing options for theexterior of the autonomous operation body 10, the voice (barking), newoperations, and the like from the store, for example.

Further, the fan pages described above may include a site for usersowning autonomous operation bodies 10 to communicate with one another.Through the fan page, the users may be able to exchange informationrelated to the autonomous operation bodies 10, or exchange actions theyhave taught the autonomous operation bodies 10.

Meanwhile, the button b12 on the home screen may be a link to anotification screen displaying notifications from the distributor of theautonomous operation body 10. FIG. 15 is an example of the notificationscreen according to this embodiment. As shown in FIG. 15, thenotification screen displays information about a system update of theautonomous operation body 10, various kinds of campaign information, andthe like, for example. The user may be able to obtain detailedinformation by tapping the respective pieces of displayed information orthe like.

Further, the button b13 on the home screen may be a link to a contentlist screen provided by the application. FIG. 16 is an example of thecontent list screen according to this embodiment. As shown in FIG. 16,the top of the content list screen according to this embodiment displaysbasic information such as the icon, the name, the gender, the date ofbirth, and the personality of the autonomous operation body 10.

As shown in the drawing, icons I1 and I2 indicating the networkconnection status and the remaining battery level of the autonomousoperation body 10 may also be displayed on the content list screen. Byvisually checking the icons I1 and I2, the user can intuitively know thenetwork connection status and the remaining battery level of theautonomous operation body 10.

Further, a plurality of buttons that is links to the content beingprovided by the application is displayed on the content list screenaccording to this embodiment. For example, a button b21 is a link tosettings content, and a button b22 is a link to appearance changecontent. Further, a button b23 is a link to photo content, and a buttonb24 is a link to physical condition check content. Meanwhile, a buttonb25 is a link to game content according to this embodiment. Further, abutton b26 is a link to the home screen.

FIG. 17 is an example of a settings content screen according to thisembodiment. As shown in FIG. 17, a volume of the voice (barking) of theautonomous operation body 10 can be set in the settings contentaccording to this embodiment, for example. The user can change thevolume of the voice of the autonomous operation body 10 or mute theautonomous operation body 10, according to the preference and thesituation.

Network settings for the autonomous operation body 10 can also be madein the settings content according to this embodiment. On the screen, theuser sets the information about the Wi-Fi or the like to which theautonomous operation body 10 is to be connected.

Further, whether or not to allow the autonomous operation body 10 totake photographs can be set in the settings content according to thisembodiment. The autonomous operation body 10 according to thisembodiment is capable of automatically taking a photograph of a person,an object, or the like the autonomous operation body 10 is interest in,or taking a photograph in accordance with an instruction from the user.On the screen, the user can set whether or not to allow the autonomousoperation body 10 to perform the photographing as described above.

Settings relating to a system update can also be made in the settingscontent according to this embodiment. The user can set whether toperform the system update automatically or manually, for example.

The name and the gender of the autonomous operation body 10 can also beset in the settings content according to this embodiment. The autonomousoperation body 10 can sense the user calling to itself and the like, byperforming voice recognition of the set name. Meanwhile, the genderaffects marking behaviors and the like the autonomous operation body 10may perform, for example.

The language and the like to be used by the autonomous operation body 10in voice recognition can also be set in the settings content accordingto this embodiment. The autonomous operation body 10 may select adictionary to be used for voice recognition, depending on the setlanguage.

Initialization of the autonomous operation body 10 and the like can alsobe performed in the settings content according to this embodiment.

Next, the appearance change content according to this embodiment isdescribed. FIG. 18 is an example of an appearance change content screenaccording to this embodiment. As shown in FIG. 18, a change in thesettings related to the exterior or the voice (barking) of theautonomous operation body 10 may be made in the appearance changecontent according to this embodiment. Here, the exterior described abovemay include color expressions related to the eyeballs, such as thepupils or the irises, for example. The user can select a colorexpression or a barking voice for the autonomous operation body 10 fromamong the variations that can be set, and causes the autonomousoperation body 10 to reflect the selected color expression or barkingvoice.

A pattern of autonomous operations that may be performed by theautonomous operation body 10 can also be newly added in the appearancechange content according to this embodiment, and the like. Variationsthat can be set and new operations that can be added in the appearancechange content increase with purchases at the store, presentdistributions, reward acquisition described later, and the like, forexample.

FIG. 19 is an example of an appearance change screen for colorexpressions of the eyeballs according to this embodiment. On the screen,the settings of color expressions of the current eyeballs (the pupils,the irises, and the like) of the autonomous operation body 10, and thevariations of the color expressions that can be changed may be displayedas a list, as shown in the drawing.

The user can check the displayed list of variations, and select adesired color, to change color expressions of the eyeballs of theautonomous operation body 10. At this stage, the reflection unit 260causes the autonomous operation body 10 to reflect the selected colorexpression, on the basis of the user's operation.

FIG. 20 is a diagram for explaining reflection of settings caused by thereflection unit 260 according to this embodiment. The left side in FIG.20 shows the head of the autonomous operation body 10 before the usermakes an appearance change setting, and the right side in FIG. 20 showsthe head of the autonomous operation body 10 after the user performs theappearance change setting.

Here, as can be seen from a comparison between the right and leftimages, the color expression of the eyeballs displayed on the displays510 and the barking voice have been changed by the user makingappearance change settings. After the appearance change settings, a newoperation of tilting the head and lifting up one ear has also beenadded. In such a manner, the reflection unit 260 according to thisembodiment can cause the autonomous operation body 10 to reflect thecorresponding exterior, voice, and new operation, on the basis of theappearance change settings made by the user. The application controlunit 250 may also cause the output expression of the avatar AV toreflect the appearance change settings as described above.

In this manner, with the application according to this embodiment, theuser can easily change the exterior and the voice of the autonomousoperation body 10, and add a new operation, according to the preference,the mood, and the like. Thus, the autonomous operation body 10 thatkeeps changing is obtained, and an effect to maintain the user'sinterest in the autonomous operation body 10 without boring the user canbe expected.

Next, the photo content according to this embodiment is described. FIG.21 is an example of a photo content screen according to this embodiment.As described above, the autonomous operation body 10 according to thisembodiment can autonomously take a photograph depending on its owninterest, or take a photograph in accordance with an instruction fromthe user. In the photo content according to this embodiment, the imagescaptured by the autonomous operation body 10 as described above can bechecked.

As shown on the left side in FIG. 21, the photo content screen accordingto this embodiment may display a list of images captured by theautonomous operation body 10 in chronological order or the like.Further, the user can select a desired photograph, so that the screenswitches to a details screen of the photograph, as shown on the rightside in FIG. 21.

The details screen of the photograph displays basic information such asthe photographing date, in addition to an enlarged image of thephotograph. Note that an image captured autonomously by the autonomousoperation body 10 may be associated with the emotion of the autonomousoperation body 10 at the time of the image capturing and the like, andbe then displayed. The user can also tap each button shown on thedetails screen or the like, to delete the photograph, share thephotograph on a fan page or in another application, download thephotograph, or the like.

Note that, in FIG. 21, images captured by the autonomous operation body10 are shown like images captured with a lens having a general angle ofview. However, the camera included in the autonomous operation body 10according to this embodiment is a wide-angle camera, and accordingly, animage captured by the autonomous operation body 10 in practice is animage having a wide angle of view and distortion.

The user can also download an image having distortion as described abovewithout any change, or can correct the distortion of the image andprocess the image as a panoramic image (corresponding to a movablephotograph in FIG. 21) before downloading the photograph.

As described above, with the application according to this embodiment,the user can easily refer to the images captured by the autonomousoperation body 10, and it is possible for the user to know internalinformation, such as what the autonomous operation body 10 wasinterested in when taking the photograph.

Next, the physical condition check content according to this embodimentis described. FIG. 22 is an example of a physical condition checkcontent screen according to this embodiment. The physical conditioncheck content according to this embodiment is content for checking theoperating condition of the autonomous operation body 10.

As shown in FIG. 22, the battery condition, the network condition, errorinformation, the operating time, and the like can be checked in thephysical condition check content according to this embodiment, forexample. The battery condition described above may include, for example,details of the remaining battery level, the time required for a fullcharge, information about the specifics of battery deterioration andreplacement, and the like.

Meanwhile, the network condition described above may include detailedinformation about the Wi-Fi to which the autonomous operation body 10 isconnected, and the communication history or the like.

Further, the error information described above may include various kindsof error information and log information related to the componentsincluded in the autonomous operation body 10 such as the actuators 570,for example.

Also, the operation time described above may include the total operatingtime of the autonomous operation body 10, and the history of theoperating times of the respective days or the like.

Further, although not shown in the drawing, transitions of emotions ofthe autonomous operation body 10, changes in the affection toward theuser, and the like may be checked in the physical condition checkcontent according to this embodiment.

As described above, with the physical condition check content accordingto this embodiment, the user can easily check the internal informationabout the autonomous operation body 10. This function is very effectivefor a device that does not have any communication means using alanguage, like the autonomous operation body 10 according to thisembodiment.

Next, the game content according to this embodiment is described. Asdescribed above, in the game content according to this embodiment, theuser can perform various kinds of communication with the avatar AVimitating the autonomous operation body 10, and obtain a rewardcorresponding to the communication. FIG. 23 is an example of a gamecontent screen according to this embodiment.

As shown in FIG. 23, in the game content according to this embodiment,the avatar AV imitating the autonomous operation body 10 is displayed,as on the home screen. The application control unit 250 causes thescreen to display the avatar AV reflecting the exterior, the voice, andthe like of the autonomous operation body 10 in a virtual living room VHin which virtual objects VO such as furniture are displayed, forexample. Note that, in a case where the user does not perform anyoperation, the application control unit 250 may control the outputexpression of the avatar AV linked with actual movements of theautonomous operation body 10, or may cause the avatar AV to perform amotion selected from among patterns such as standing on four feet,sitting down, lying down, and walking.

Further, a button b31 for returning to the home screen, a button b32that is a link to an explanation screen for explaining how to play thegame content, and the like are displayed on the game content screenaccording to this embodiment. FIG. 24 is an example of a game contentexplanation screen according to this embodiment. As shown in FIG. 24,the user can deepen communication with the avatar AV by performingoperations such as touching, stroking, or throwing a ball or abone-shaped toy, for the displayed avatar AV.

As shown FIG. 23, a lower portion of the game content screen displaysvirtual objects corresponding to a ball-shaped toy T1 and a bone-shapedtoy T2, and an upper portion of the screen displays meters Mcorresponding to various kinds of communication, such as touching,stroking, and playing using the ball-shaped toy T1 or the bone-shapedtoy T2. The meters M indicate the intensities corresponding tocommunication types, and become higher with the number of tapping(touching) operations performed by the user, or the like, for example.Here, in a case where a meter M reaches the upper limit, the applicationcontrol unit 250 gives a reward corresponding to the communication type,and the reflection unit 260 causes the autonomous operation body 10 toreflect the contents of the reward.

The application control unit 250 according to this embodiment may alsocause the avatar AV to perform various kinds of reactions correspondingto user operations. For example, in a case where a touching (tapping)operation is performed, the application control unit 250 may cause theavatar AV to perform an action, such as barking, wagging the tail,curling the back, scratching the head, giving high five, or begging.

Further, in a case where a stroking (flicking) operation is performed,the application control unit 250 may cause the avatar AV to perform anaction, such as raising the head and shaking the body, kissing, andturning over (showing the belly).

The same applies to playing using a virtual object such as theball-shaped toy T1 or the bone-shaped toy T2. FIG. 25 is a diagram forexplaining an interaction between the autonomous operation body 10 andthe user via the ball-shaped toy T1 according to this embodiment.

As shown in FIG. 25, in the game content according to this embodiment,the user can throw the ball-shaped toy T1 toward the avatar AV byflicking the ball-shaped toy T1 displayed at the lower portion of thescreen.

At this stage, the application control unit 250 controls the operationdisplay of the ball-shaped toy T1 in accordance with the laws ofphysics, for example, and causes the avatar AV to react to theball-shaped toy T1. The application control unit 250 may cause theavatar AV to perform an action, such as smelling, pushing theball-shaped toy T1 in the rightward or leftward direction or forwardwith the nose tip, putting one forefoot on the ball-shaped toy T1,holding down the ball-shaped toy T1 with both forefeet and biting on it,or kicking the ball-shaped toy T1 in the rightward or leftward directionor forward, for example. The application control unit 250 according tothis embodiment may also cause the screen to display an effect Elrelated to an emotional expression as one reaction, as shown in FIG. 25.

Further, FIG. 26 is a diagram for explaining an interaction between theautonomous operation body 10 and the user via the bone-shaped toy T2according to this embodiment. As with the ball-shaped toy T1, the usercan throw the bone-shaped toy T2 toward the avatar AV by flicking thebone-shaped toy T2 displayed at the lower portion of the screen.

At this stage, the application control unit 250 controls the operationdisplay of the bone-shaped toy T2 in accordance with the laws ofphysics, for example, and causes the avatar AV to react to thebone-shaped toy T2.

The application control unit 250 may cause the avatar AV to perform anaction, such as sniffling the bone-shaped toy T2, pushing thebone-shaped toy T2 in the rightward or leftward direction or forwardwith the noise tip, standing the bone-shaped toy T2, knocking down thebone-shaped toy T2, holding the bone-shaped toy T2 in the mouth, shakingthe bone-shaped toy T2 while holding it in the mouth, or lifting up anddown the bone-shaped toy T2, for example.

As described above, in the game content according to this embodiment,the user can perform various kinds of communication with the avatar AVimitating the autonomous operation body 10. Further, as described above,in a case where the intensity of one of the various kinds ofcommunication (the number of times an operation has been performed bythe user, or the number of times the avatar AV has performed a reaction,for example) has reached a predetermined value, the application controlunit 250 may give a reward corresponding to the communication type.

FIG. 27 is an example of a reward acquisition pop-up according to thisembodiment. In a case where the intensity of one of the various kinds ofcommunication has reached a predetermined value because of an operationperformed by the user, which is a case where the meter M has reached itsmaximum, the application control unit 250 causes the game content todisplay a pop-up screen therein, as shown in FIG. 27. In the examplecase illustrated in FIG. 27, the application control unit 250 gives anew behavior, which is a new operation the autonomous operation body 10can perform, as a reward, and causes the screen to display anotification to the effect that the reward has been acquired.

As described above, the reward according to this embodiment may be areward related to a functional enhancement of the autonomous operationbody 10, for example. The functional enhancement described above may bean addition of a new operation the autonomous operation body 10 canperform as shown in FIG. 27, but may be an addition of a variation ofthe exterior such as a color expression for the eyeballs, an addition ofa variation of the voice (barking) of the autonomous operation body 10,or the like.

Further, the application control unit 250 according to this embodimentmay cause the screen to display a pop-up screen as shown in FIG. 27, andcause the output expression of the avatar AV to reflect a given reward.The application control unit 250 may cause the avatar AV to perform anew operation given as the reward, or may cause the output expression ofthe avatar AV to reflect a new variation of the exterior or the voicegiven as the reward. With the above functions of the application controlunit 250 according to this embodiment, the user can visually recognize anewly acquired reward each time, and make an appearance change settingaccording to the user's preference.

Meanwhile, the reflection unit 260 according to this embodiment causesthe autonomous operation body 10 to reflect a newly acquired reward,which is an addition of a new operation or an addition of a variation ofthe exterior or the voice. In a case where a reward is a new operation,the reflection unit 260 according to this embodiment also transmits thecontrol sequence data for causing the autonomous operation body 10 toperform the new operation, to the autonomous operation body 10 via theterminal communication unit 270.

As described above, with the game content according to this embodiment,the user can communicate with the avatar AV imitating the autonomousoperation body 10 even from outside the home, to obtain a rewardrelating to a functional enhancement and cause the autonomous operationbody 10 to reflect the reward.

The above is a description of an example of the game content accordingto this embodiment. Note that the above description is merely anexample, and the game content according to this embodiment is notlimited to this example.

For example, a user operation is not necessarily an input operationperformed on the input unit 310 by the user. A user operation accordingto this embodiment may be a voice input, for example. In other words,the user may be able to communicate with the avatar AV by voice.

Further, in the above description, the application control unit 250causes the avatar AV to perform various kinds of operationscorresponding to operations performed by the user. However, such anoperation may be an unacquired operation the autonomous operation body10 is still unable to perform. In this case, the application controlunit 250 according to this embodiment counts the number of times theavatar AV has performed each unacquired operation and the like. In acase where the number of times exceeds a threshold, the applicationcontrol unit 250 may give the unacquired operation as a reward.

Further, the application control unit 250 according to this embodimentmay select a reward according to a feedback from the user. For example,the application control unit 250 may cause the avatar AV to randomlyperform a plurality of unacquired operations, and select an unacquiredoperation to which the user has showed a good reaction, as a reward.Note that a reaction of the user may be analyzed on the basis of anutterance of the user detected by the input unit 310, a face image ofthe user, or the like, for example.

The user may also be able to cause the avatar AV and the autonomousoperation body 10 to perform learning related to recognition of a newobject, via the input unit 310. For example, the user utters the name orthe like corresponding to an object while showing the object to theavatar AV via an imaging device included in the input unit 310. At thisstage, the information processing server 20 may associate an image ofthe object with a voice recognition result, and additional register theimage in an object recognition dictionary included in the autonomousoperation body 10. With the information processing server 20 accordingto this embodiment, it is possible to perform continuous communication,so that, after the user has returned home, the autonomous operation body10 remembers the content the user taught to the avatar AV from outsidethe home, for example.

Further, in the above described example case, the application controlunit 250 causes a display device or the like included in the informationprocessing terminal 30 to display a user interface. However, displaycontrol according to this embodiment is not limited to this example. Theapplication control unit 250 according to this embodiment can alsoperform display control on the avatar AV by an augmented reality (AR)technology, a virtual reality (VR) technology, a mixed reality (MR)technology, or the like, for example.

2.3. Control Flow

Next, the flow in control to be performed by the information processingserver according to this embodiment is described in detail. First, theflow in appearance change settings control to be performed by theinformation processing server 20 according to this embodiment isdescribed. FIG. 28 is a flowchart showing the flow in appearance changesettings control to be performed by the information processing server 20according to this embodiment.

As shown in FIG. 28, first, the terminal communication unit 270 acquiresinformation about the state of the autonomous operation body 10 (S1101).

The application control unit 250 then continuously performs operationcontrol on the application, including control on the output expressionof the avatar, depending on the state acquired in step S1101 (S1102).

Here, if an appearance change setting is made by the user (S1103: YES),the reflection unit 260 performs a process of causing the autonomousoperation body 10 to reflect the selected setting.

Here, if the appearance change setting is addition of a behavior, whichis a new operation (S1104: YES), the reflection unit 260 transmitscontrol sequence data for causing the autonomous operation body 10 toperform the new operation, to the autonomous operation body 10 via theterminal communication unit 270 (S1105).

If the appearance change setting is a setting related to the exterior ora voice variation (S1104: NO), on the other hand, the reflection unit260 causes the autonomous operation body 10 to reflect the selectedsetting (S1106).

The information processing server 20 repeatedly performs the processstarting from step S1101, until an application end operation isperformed (S1107: YES).

Next, the flow in game content control according to this embodiment isdescribed in detail. FIG. 29 is a flowchart showing the flow in gamecontent control to be performed by the information processing server 20according to this embodiment.

As shown in FIG. 20, first, the terminal communication unit 270 acquiresinformation about the state of the autonomous operation body 10 (S1201).

The application control unit 250 then continuously performs operationcontrol on the game content, on the basis of the information acquired instep S1201 (S1202).

Here, if an operation is performed on the avatar by the user (S1203:YES), the application control unit 250 adds a point to the communicationtype corresponding to the operation (S1204).

Here, if the points described above exceed a predetermined value (S1205:YES), the application control unit 250 causes the screen to display anotification relating to reward acquisition depending on thecommunication type (S1206), and also causes the avatar to reflect thecontents of the reward (S1207).

The reflection unit 260 also causes the autonomous operation body 10 toreflect the functional enhancement setting corresponding to the acquiredreward (S1208).

The information processing server 20 repeatedly performs the processstarting from step S1201, until a game content end operation isperformed (S1209: YES).

3. Example Hardware Configuration

Next, an example hardware configuration common to the informationprocessing server 20 and the information processing terminal 30according to an embodiment of the present disclosure is described.

FIG. 30 is a block diagram showing an example hardware configurationexample of the information processing server 20 and the informationprocessing terminal 30 according to an embodiment of the presentdisclosure. As shown in FIG. 30, the information processing server 20and the information processing terminal 30 include a CPU 871, a ROM 872,a RAM 873, a host bus 874, a bridge 875, an external bus 876, aninterface 877, an input device 878, an output device 879, a storage 880,a drive 881, a connecting port 882, and a communication device 883, forexample. Note that the hardware configuration shown herein is anexample, and some of the components may be omitted. Further, componentsother than the components shown herein may be further included.

CPU 871

The CPU 871 functions as an arithmetic processing unit or a controldevice, for example, and controls the overall operation of eachcomponent or part thereof, on the basis of various kinds of programsrecorded in the ROM 872, the RAM 873, the storage 880, or a removablerecording medium 901.

ROM 872 and RAM 873

The ROM 872 is a means for storing programs to be read by the CPU 871,data to be used for calculation, and the like. The RAM 873 temporarilyor permanently stores programs to be read by the CPU 871, various kindsof parameters that change as appropriate when the programs are executed,and the like, for example.

Host bus 874, Bridge 875, External bus 876, and Interface 877

The CPU 871, the ROM 872, and the RAM 873 are connected to one anothervia the host bus 874 capable of high-speed data transmission, forexample. Meanwhile, the host bus 874 is connected to the external bus876 having a relatively low data transmission rate via the bridge 875,for example. The external bus 876 is further connected to variouscomponents via the interface 877.

Input Device 878

The input device 878 is formed with a mouse, a keyboard, a touch panel,a button, a switch, a lever, and the like, for example. Further, theinput device 878 may be formed with a remote controller capable oftransmitting a control signal using infrared rays or other radio waves.The input device 878 also includes a sound input device such as amicrophone.

Output Device 879

The output device 879 is a display device such as a cathode ray tube(CRT), an LCD, or an organic EL, an audio output device such as aspeaker or headphones, or a device capable of visually or audiblynotifying the user of acquired information, such as a printer, a mobilephone, or a facsimile, for example. The output device 879 according tothe present disclosure also includes any one of various vibrationdevices capable of outputting tactile stimulation.

Storage 880

The storage 880 is a device for storing various kinds of data. Thestorage 880 may be a magnetic storage device such as a hard disk drive(HDD), a semiconductor storage device, an optical storage device, amagnetooptical storage device, or the like, for example.

Drive 881

The drive 881 is a device that reads information recorded on theremovable recording medium 901 such as a magnetic disk, an optical disk,a magnetooptical disk, or a semiconductor memory, or writes informationon the removable recording medium 901, for example.

Removable Recording Medium 901

The removable recording medium 901 is a DVD medium, a Blu-ray(registered trademark) medium, an HD DVD medium, any one of varioussemiconductor storage media, or the like, for example. The removablerecording medium 901 may of course be an IC card on which a noncontactIC chip is mounted, an electronic device, or the like, for example.

Connecting Port 882

The connecting port 882 is a port for connecting an external connectiondevice 902, such as a universal serial bus (USB) port, an IEEE1394 port,a small computer system interface (SCSI), an RS-232C port, or an opticalaudio terminal, for example.

External Connection Device 902

The external connection device 902 is a printer, a portable musicplayer, a digital camera, a digital video camera, an IC recorder, or thelike, for example.

Communication Device 883

The communication device 883 is a communication device for connecting toa network, such as a wired or wireless LAN, Bluetooth (registeredtrademark), a communication card for a wireless USB (WUSB), a router foroptical communication, a router for an asymmetric digital subscriberline (ADSL), a modem for any of various kinds of communication, or thelike, for example.

4. Summary

As described above, the information processing server 20 according to anembodiment of the present disclosure includes: the application controlunit 250 that controls operation of an application relating tocommunication between an autonomous operation body 10 and a user; and areflection unit 260 that causes the autonomous operation body to reflectan operation performed by the user in the application. Further, one ofthe features of the application control unit 250 according to anembodiment of the present disclosure is to control operation of anavatar imitating the autonomous operation body 10, and the reflectionunit 260 causes the autonomous operation body to reflect a rewardobtained by the avatar in accordance with the user's operation. Withsuch a configuration, communication between the autonomous operationbody and the user can be made more active.

While preferred embodiments of the present disclosure have beendescribed above with reference to the accompanying drawings, thetechnical scope of the present disclosure is not limited to theseexamples. It is apparent that those who have ordinary skills in thetechnical field of the present disclosure can make various changes ormodifications within the scope of the technical spirit claimed herein,and it should be understood that those changes or modifications arewithin the technical scope of the present disclosure.

Furthermore, the effects disclosed in this specification are merelyillustrative or exemplary, but are not restrictive. That is, thetechnology according to the present disclosure may achieve other effectsobvious to those skilled in the art from the description in the presentspecification, in addition to or instead of the effects described above.

It is also possible to create a program for causing hardware such as aCPU, a ROM, and a RAM in a computer to have functions equivalent tothose of the components of an autonomous operation body 10 and theinformation processing server 20, and provide computer-readablenon-transitory recording medium storing the program.

Further, the respective steps relating to the processes to be performedby the autonomous operation bodies 10 and the information processingserver 20 in the present disclosure are not necessarily carried out inchronological order according to the sequences shown in the flowcharts.For example, the respective steps relating to the processes to beperformed by the autonomous operation bodies 10 and the informationprocessing server 20 may be carried out in a different order from thesequences shown in the flowcharts, or may be carried out in parallel.

Note that the configurations described below are also within thetechnical scope of the present disclosure.

(1)

An information processing device including:

an application control unit that controls operation of an applicationrelating to communication between an autonomous operation body and auser; and

a reflection unit that causes the autonomous operation body to reflectan operation performed by the user in the application, in which

the application control unit controls operation of an avatar imitatingthe autonomous operation body, and

the reflection unit causes the autonomous operation body to reflect areward obtained by the avatar on the basis of the operation performed bythe user.

(2)

The information processing device according to (1), in which

the reward includes a functional enhancement of the autonomous operationbody.

(3)

The information processing device according to (2), in which

the functional enhancement includes an addition of a new operation theautonomous operation body is able to perform.

(4)

The information processing device according to (3), in which

the reflection unit causes transmission of control sequence data to theautonomous operation body, the control sequence data being for causingthe autonomous operation body to perform the new operation.

(5)

The information processing device according to any one of (2) to (4), inwhich

the functional enhancement includes an addition of a variation relatingto an exterior of the autonomous operation body.

(6)

The information processing device according to (5), in which thevariation relating to the exterior includes at least a color expression.

(7)

The information processing device according to any one of (2) to (6), inwhich

the functional enhancement includes an addition of a variation relatingto voice of the autonomous operation body.

(8)

The information processing device according to any one of (1) to (7), inwhich

the application control unit controls an output expression relating tothe avatar, on the basis of a state of the autonomous operation body.

(9)

The information processing device according to any one of (1) to (8), inwhich

the application control unit causes an output expression of the avatarto reflect an operation being performed by the autonomous operationbody.

(10)

The information processing device according to any one of (1) to (9), inwhich

the application control unit causes an output expression of the avatarto reflect an emotion of the autonomous operation body.

(11)

The information processing device according to (9) or (10), in which

the output expression includes at least one of an operation display, acolor expression, or a voice output.

(12)

The information processing device according to any one of (1) to (11),in which

the application control unit causes an output expression of the avatarto reflect the reward obtained by the avatar.

(13)

The information processing device according to any one of (1) to (12),in which

the application control unit controls operation of game content relatingto communication between the avatar and the user, and

the application control unit gives the reward, on the basis of anintensity of communication with the user in the game.

(14)

The information processing device according to (13), in which

the communication in the game includes contact with the avatar, or aninteraction with the avatar via a virtual object.

(15)

An information processing method implemented by a processor,

the information processing method including:

controlling operation of an application relating to communicationbetween an autonomous operation body and a user; and

causing the autonomous operation body to reflect an operation performedby the user in the application, in which

the controlling further includes controlling operation of an avatarimitating the autonomous operation body, and

the causing further includes causing the autonomous operation body toreflect a reward obtained by the avatar on the basis of the operationperformed by the user.

(16)

A program for causing a computer to function as an informationprocessing device that includes:

an application control unit that controls operation of an applicationrelating to communication between an autonomous operation body and auser; and

a reflection unit that causes the autonomous operation body to reflectan operation performed by the user in the application, in which

the application control unit controls operation of an avatar imitatingthe autonomous operation body, and

the reflection unit causes the autonomous operation body to reflect areward obtained by the avatar on the basis of the operation performed bythe user.

REFERENCE SIGNS LIST

-   10 Autonomous operation body-   110 Input unit-   120 Recognition unit-   130 Learning unit-   140 Action planning unit-   150 Operation control unit-   160 Drive unit-   170 Output unit-   510 Display-   570 Actuator-   20 Information processing server-   210 Learning unit-   220 Action recommendation unit-   230 Analysis unit-   240 Storage unit-   250 Application control unit-   260 Reflection unit-   270 Terminal communication unit-   30 Information processing terminal

1. An information processing device comprising: an application controlunit that controls operation of an application relating to communicationbetween an autonomous operation body and a user; and a reflection unitthat causes the autonomous operation body to reflect an operationperformed by the user in the application, wherein the applicationcontrol unit controls operation of an avatar imitating the autonomousoperation body, and the reflection unit causes the autonomous operationbody to reflect a reward obtained by the avatar on a basis of theoperation performed by the user.
 2. The information processing deviceaccording to claim 1, wherein the reward includes a functionalenhancement of the autonomous operation body.
 3. The informationprocessing device according to claim 2, wherein the functionalenhancement includes an addition of a new operation the autonomousoperation body is able to perform.
 4. The information processing deviceaccording to claim 3, wherein the reflection unit causes transmission ofcontrol sequence data to the autonomous operation body, the controlsequence data being for causing the autonomous operation body to performthe new operation.
 5. The information processing device according toclaim 2, wherein the functional enhancement includes an addition of avariation relating to an exterior of the autonomous operation body. 6.The information processing device according to claim 5, wherein thevariation relating to the exterior includes at least a color expression.7. The information processing device according to claim 2, wherein thefunctional enhancement includes an addition of a variation relating tovoice of the autonomous operation body.
 8. The information processingdevice according to claim 1, wherein the application control unitcontrols an output expression relating to the avatar, on a basis of astate of the autonomous operation body.
 9. The information processingdevice according to claim 1, wherein the application control unit causesan output expression of the avatar to reflect an operation beingperformed by the autonomous operation body.
 10. The informationprocessing device according to claim 1, wherein the application controlunit causes an output expression of the avatar to reflect an emotion ofthe autonomous operation body.
 11. The information processing deviceaccording to claim 9, wherein the output expression includes at leastone of an operation display, a color expression, or a voice output. 12.The information processing device according to claim 1, wherein theapplication control unit causes an output expression of the avatar toreflect the reward obtained by the avatar.
 13. The informationprocessing device according to claim 1, wherein the application controlunit controls operation of game content relating to communicationbetween the avatar and the user, and the application control unit givesthe reward, on a basis of an intensity of communication with the user inthe game.
 14. The information processing device according to claim 13,wherein the communication in the game includes contact with the avatar,or an interaction with the avatar via a virtual object.
 15. Aninformation processing method implemented by a processor, theinformation processing method comprising: controlling operation of anapplication relating to communication between an autonomous operationbody and a user; and causing the autonomous operation body to reflect anoperation performed by the user in the application, wherein thecontrolling further includes controlling operation of an avatarimitating the autonomous operation body, and the causing furtherincludes causing the autonomous operation body to reflect a rewardobtained by the avatar on a basis of the operation performed by theuser.
 16. A program for causing a computer to function as an informationprocessing device that includes: an application control unit thatcontrols operation of an application relating to communication betweenan autonomous operation body and a user; and a reflection unit thatcauses the autonomous operation body to reflect an operation performedby the user in the application, wherein the application control unitcontrols operation of an avatar imitating the autonomous operation body,and the reflection unit causes the autonomous operation body to reflecta reward obtained by the avatar on a basis of the operation performed bythe user.